^- 4 

PAPER DOCUMENT 
INPUTTING UNIT 



1 



DOCUMENT WITH 
NOTE 



NOTE EXTRACTING 1 


JNIT * 






-6 


NOTE RECOGNIZING 


UNIT « 




-7 


NOTE REGISTERING! 


JNIT 



-< 



13 



CHARACTER RECOGNITION 
DICTIONARY 



USER INTERFACE 
UNIT 



DOCUMENT 
SEARCHING UNIT 



ELECTRONIC 
DOCUMENT 



ELECTRONIC DOCUMENT 
REGISTERING UNIT 



FILE MANAGING UNIT 



DOCUMENT INFORMATION 
FILE _ 



ORIGINAL DOCUMENT 
^ FILE 



NOTE RECOGNITION 
RESULT FILE 




NOTE IMAGE FILE 



F I G. 1 



CORRECTING LEAN OF DOCUMENT 




IMAGE W 


TH NOTE 






/ 





GENERATING IMAGE FROM 
ORIGINAL ELECTRONIC 
DOCUMENT 



REMOVING PREPRINT, FOR 
EXAMPLE, BY OVERLAYING 
DOCUMENT IMAGE WITH NOTE AND 
DOCUMENT GENERATED FROM 
ORIGINAL ELECTRONIC 
DOUCUMENT 



DOCUMENT 
INFORMATION FILE 



ELECTRONIC 
DOCUMENT FILE 



EXTRACTING CHARACTERS FROM 
NOTE IMAGE 



PERFORMING CHARACTER 
RECOGNITION FOR NOTE 
IMAGE 



FIG. 2 



xxxxxxxxxxx 



xxxxxxxxxxx 



xxxxxxx 



xxxxxxxxxxx 



xxxxxxxxxxx 



xxxxxxx 



(a) DOCUMENT 

IMAGE WITH NOTE 



(b) DOCUMENT IMAGE 
GENERATED FROM 
ELECTRONIC DOCUMENT 



(c)OVERLAID 
DIFFERENTIAL 
IMAGE 



(d)NOTE REGION 
EXTRACTION 



F I G.3 



DOCUMENT 
INFORMATION FILE 



DISPLAYING DOCUMENT 
REGISTRATION MENU 



REGISTERING ELECTRONIC 
DOCUMENT TO BE CORRELATED 



S10 



S11 



S12 



READING FROM FILE OF SPECIFIED 
ELECTRONIC DOCUMENT 



INPUTTING PAPER 
DOCUMENT WITH NOTE 



NOTE EXTRACTION/ 
RECOGNITION PROCESS 



S14 



DISPLAYING NOTE 
RECOGNITION RESULT 



S15 



S16 



CORRECTING NOTE 
RECOGN I TON RESULT 



S17 



STORING NOTE RECOGNITION RESULT AND 
NOTE IMAGE, AND WRITING I NFORAM I TON 
TO DOCUMENT INFORMATION FILE 




DOCUMENT 
INFORMATION FILE 

ELECTRONIC 
DOCUMENT FILE 



CHARACTER 
RECOGNITION 
DICTIONARY 



NOTE RECOGNITION 
RESULT FILE 



NOTE IMAGE 
FILE 



DOCUMENT 
INFORMATION FILE 



F I G. 4 





ril r MARIC 

FILE NAME 




TITI r 

1 1 ILL 




v/cdciam kin 
VhKblUN NU. 




PROTECTION INFORMATION 


1 


nro 1 PTDAT 1 AM n A TC A MI"V T 1 RIC 

REGISTRATION DATE AND TIME 


DUGUMENT lire 




FILE SIZE INFORMATION 




POINTER TO ELECTRONIC DOCUMENT FILE 




NUMBER OF NOTES 




ARRAY OF POINTERS TO NOTE RECOGNITION RESULT FILES 




ARRAY OF POINTERS TO NOTE IMAGE FILES 




NOTE LOCATION INFORMATION 



F I G. 5 



SPECIFYING WORD BY USER \/ S2 ° 
S21 



REFERENCING DOCUMENT J 
I NFORMA I TON FILE 



SEARCH I NG FOR CHARACTER CODE OF 
SPECIFIED WORD IN ELECTRONIC 
DOCUMENT FILE AND CORRELATED 
NOTE RECOGNITION RESULT 



y 



S22 



MAKING RESULT VISIBLE ON 
DISPLAY 



V 



S23 



F I G. 6 



X 








1 


— 1 
CM 



8 



|| gg 

O O LV C--J i 

>-qq>-: 
<n o o <e ■ 

O 3= 3= O i 



i— < s 

£ S 3S ,_ cvl 

£ s <g _j _j 

! ^ — ^ fE 

■ u_ u- ce □£ 

, . L1J U-l LU LU 

=! !< < 

^ W W J, C3 

CO w z z 

-5_ LU LU _ — 

q KCC |_ h- 

D C3g UJ LU 



s 



xxx | DISPLAY | xxx | 




















xxxxxxxxxxxx 
xxxxxxxxxxxx 










X X X X X X X 

XXXXXXXXXXXX 
XXXXXXXXXXX 





m 
in 
□ 



XXX 






NOTE 






NOTE 


IMAGE 



FIG. 8 A 



FIG. 8 B 



BUS 



CPU 



21 



22 



MEMORY 



. 23 



INPUT DEVICE 



24 



^ 28 


J 26 




EXTERNAL 




STORAGE DEVICE 




J 26 




MEDIUM DRIVING 




DEVICE 



27 



29 



PORTABLE 
STORAGE MED 1 1 





NETWORK 
CONNECTION 
DEVICE 






< ► 



-> NETWORK 



OUTPUT DEVICE 



FIG.9 




F I G. 1 0 



